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PREFACE 

This document reports processing and analysis eftorts on one task 
of a comprehensive and continuing program of research in multispectral 
remote sensing of the environment. The research is being carried out 
for NASA's Lyndon B. Johnson Space Center, Houston, Texas, by the 
Environmental Research Institute of Michigan (ERIM) , The basic objec- 
tive of this program is to develop remote sensing as a practical tool 
for obtaining extensive environmental information quickly and economi- 
cally . 

The specific focus of the work reported herein was an investiga- 
tion of the effects of spatial misregistration on one’s ability to 
extract information from multispectral scanner data, especially for 
agricultural inventories. 

The research covered in this report was performed under Contract 
NAS9-14123 during the period 15 May 1975 to 14 May 1976, Dr. Andrew 
Potter (TF3) served as the NASA Contract Technical Monitor. At ERIM, 
work was performed within the Infrared and Optics Division, headed by 
Richard R. Legault, Vice-President of ERIM, in the Information Systems 
and Analysis Department, headed by Dr, Jon D. Erickson. Mr. Richard 
F. Nalepka, Head of the Multispectral Analysis Section served as 
Principal Investigator. 

The authors wish to acknowledge the assistance of other members 
of the ERIM staff in addition to those cited above. Dr. R. B. Crane 
suggested and consulted on the derivation of the signature simulation 
model (App . II) and the analysis of the special two-distribution case 
(App. I) which were carried out by R. Cicone, Dr. H, M, Horwitz 
derived the generalized procedure for estimating the expected number 
of boundary pixels in a scene (Sec, 4.1); the extension to misregi- 
stered data (Sec, 4.2) was by J. Gleason and W. Malila. Typing of 
this report and earlier materials was performed ably by Miss. D. 
Dickerson, 
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1 

SUMMARY, CONCLUSIONS, AND RECOMIIENDATIONS 


Spatial misregistration in multi temporal LANDSAT multispectral 
scanner data can potentially degrade the performance of recognition 
processors operating on such data for applications like LACIE, the 
Large Area Crop Inventory Experiment. The major objective of this 
investigation was to evaluate the effects of spatial misregistration 
on recognition performance. The major effort planned for this investi- 
gation could not be carried out because the prime requisite data, accu- 
rately registered LANDSAT multi temporal data sets, were not delivered 
as expected. The sliding delivery schedule and high priorities on 
efforts for other tasks of this contract also resulted in a reduction 
of resources allocated for this particular investigation. Nevertheless, 
some useful analyses were carried out. 

A model for estimating the number of multiclass pixels in the 
scene, i.e,, pixels which represent more than one ground cover class, 
such as along field boundaries, was generalized and extended to include 
misregistration effects. These models apply to situations where the 
pixel dimensions are small in comparison to field dimensions. A series 
of parametric graphs was then generated to portray the influei.ee of the 
key variables. Another substantial effort was the development of a 
simulation model to generate signatures (mean vectofs and variance- 
covariance matrices) to represent the distributions of signals fro. a 
misregistered multiclass pixels, based on single-class signatures 
extracted from data sets of interest. Also, computer programs to 
induce mi.sreglstration by fixed amounts in accurately registered data 
were written, although not used, and the between-channel misregistration 
in two single- time LACIE segments of LANDSAT data was measured, 

1.1 CONCLUSIONS 


(1) The two major direct effects of spatial misregistration on 
multitemporal data are; 

i. 1 
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(a) an increase in the percentage of pixels that are multi- 
class pixels and 

(b) a decorrelation of signals in spatially misregistered data. 

(2) Use of the method developed to estimate the expected propor- 
tion of multiclass pixels in both registered and misregistered data 
showed that: 

(a) Estimates obtained using the method were reasonably 
similar to empirical measurements for four LACIE intensive test sites 
in Kansas . 

(b) The proportion of raulticlass pixels in a scene is pro- 
portional in an approximate sense to the perimeter of the pixel and to 
the ratio of the total perimeter of the fields in the scene to the area 
of the scene. 

(c) For the four intensive test sites, the perimeter-to-area 
ratio for each site, plotted against the average field size within each, 
produced a smooth curve. This would indicate that the perimeter-to- 
area ratio, and consequently the expected proportion of multiclass 
pixels, can be determined in an approximate sense directly from the 
average field sise for any site in the Kansas region or any other 
region with similar field patterns. 

(d) For a simulated, rectangular field pattern, the expected 
proportion of multiclass pixels is most sensitive to variations in the 
size of the fields and their aspect ratio when these quantities are 
small. 

(e) For the simulated field pattern, the expected proportion 
of multiclass pixels decreases as the size of the fields increases and 
as their shape approaches that of a square. 

(£) Misregistration increases the proportion of multiclass 
pixels, dependent, on the magnitude and direction of the misregistration 
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and the size of the pixelj this increase is equivalent to the effect 
of using a larger pixel size, 

(3) The increased percentage of multiclass pixels present in a 
misregistered scene has the following effects on computer recognition 
processing and performance: 

(a) Fewer single^class pixels are available for training, 
and more stringent inset requirements must be placed on the specifi- 
cation of single-class training fields to insure that multiclass pixels 
are excluded. 

(b) Fewer single-class pixels are available for recognition 
and chances for recognition errors and crop area estimation biases 
among multiclass pixels are increased. Quantification of these effects 
for LACIE data was an unachieved objective of this investigation due to 
the unavailability of the requisite data. However, the simulation model 
developed was used to demonstrate such effects for SKYLAB S-192 data 
from a corn-soybean agricultural scene under another Investigation. 

(4) The reduction of correlation between misregistered data 
channels would have the fallowing effects on recognition processing 
and performance: 

(a) For single-class pixels, although not intuitively obvious 
misregistration might possibly decrease probability of misclassif ication 
other simulation studies have shown misregistration effects on single- 
class pixels to be negligible, 

(b) For multiclass pixels, hox-zever, misregistration effects 
have been sho™ to be substantial in other studies, but the effects of 
different proportions of materials present and decreased correlation 
between misregistered channels are difficult to separate; the comments 
of (3) (b) apply here as well. 

(5) No evidence of significant amounts of between-channel mis- 
registration in single-pass LANDSAT data was found in the txvo data 
segments analyzed. 


3 


FORMERLY WILLOW RUN LABOBATORieS, THE UNIVERSITY OF MICHIGAN 

1.2 RECOMMENDATIONS 

Although the contract effort could not be completed as originally 
planned, the work which has been, performed and reported herein has 
yielded both additional insight into the overall di.f f iculties attri- 
butable to misregistration and tools with which to further evaluate 
its effects. On this basis, the following recommendations are made: 

(1) The effects of misregistration on recognition accuracy and 
proportion estimation accuracy should be quantified more fully for 
the LACIE application and other applications. 

(a) Methods using the simulation models developed in the 
reported effort could be investigated and used to address this ques- 
tion in a general sense but yet with primary emphasis on the LACIE 
application. Clearly, the effects of misregistration on recognition 
accuracy and proportion estimation accuracy depend in large part on 
the field pattern, the signatures of the various crop categories, and 
the true crop proportions in the particular scene analyzed. The 
models developed xvould allow the expected proportions of multiclass 
and single-class pixels to be determined as a function of the amount 
of misregistration for typical LACIE field patterns. The signatures 

of these multiclass pixels could then be simulated from typical single- 
class LACIE crop signatures. With these and other tools, the effects 
of misregistration could be more thoroughly investigated than pre- 
viously possible. 

(b) The accurately registered LACIE multitemporal data sets 
that are nox<? available should be used to evaluate the effects of mis- 
registration on these specific data sets, as originally planned, for 
the dual purpose of obtaining quantitative results for specific data 
sets and verifying the accuracy of the simulation models . 

(2) Additional investigation should be made of the ERIM method 
for estimating the expected proportion of multiclass pixels in a scene. 
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(a) Further efforts should be undertaken to evaluate its 
accuracy and utility. 

(b) Tests should be conducted to determine if the perimeter- 
to-area ratio of a scene can be accurately related to the average field 
size within the scene in terms of the standard agricultural practices 
used in a given geographical area. If such a relationship can be 
established, the only Information necessary to estimate the expected 
proportion of multiclass pixels in a particular scene, by the approxi- 
mate ERIM method, is the average field size in that scene. 

(c) The method should be extended further to account for 
the effects of both pixel ground area overlap and simultaneous mis- 
registration along and between scan lines on the expected proportion 
of multiclass pixels in a scene. 
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INTRODUCTION 

One of the major uses being developed for LANDSAT multispectral 
scanner data is for the inventory of agricultural crops and production 
forecasting, e.g., LACIE, the Large Area Crop Inventory Experiment. 
Average misregistrations of nearly one pixel have been reported in LACIE 
multitemporal data [1]. The major objective of the effort reported 
herein was to evaluate the effects of spatial misregistration on recog- 
nition performance of processors operating on multitemporal LANDSAT data. 

Spatial misregistration produces two effects in multitemporal data 
which potentially can degrade recognition performance. First, it 
increases the proportion of scene multiclass pixels which repre.sent 
signals from more than one class of ground cover (e.g., mixture pixels 
which occur at or near field boundaries) . This increase in the propor- 
tion of multiclass pixels both reduces the availability of pure field- 
center (single-class) pixels for training and increases the likelihood 
of recognition errors in the scene, as will be shown in the analyses 
that follow. The second effect of misregistration is on single-class 
pixels where it reduces the correlation between signals in the channels 
that are out of registration , 

Initial work on this effort was begun and reported last year [2]. 

A simple model was developed to simulate signatures from misregistered 
pixels that contained mixtures of two materials , Initial calculations 
were made using CITARS data signatures to predict the effects of such 
misregistration on recognition performance, and it xjas sho^m to poten^ 
tially cause substantial degradation. 

The signature simulation model was generalized and improved more 
recently under joint support of this contract and a Skylab investigation 


Contract NAS9-13280 with NASA’s Johnson Space Center, Houston, 
Texas ; the final report is Ref . 3 . 
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carried out at ERIM, Simulations of misregistration effects in single- 
pass Skylab S-192 multispectral scanner data were made using the improved 
model j analyzed, and reported in Ref. 3. In brief, it was found that 
(a) the availability of single-class (field-center) pixels was substan- 
tially reduced for small amounts (one pixel and even less) of misregi- 
stration, (b) classification accuracy for single-class pixels was not 
significantly affected by misregistration, (c) overestimates of the 
proportions of certain crops were linked directly to misregistration, 
and (d) overall classification accuracy was degraded by misregistration, 
bringing into question the common belief or tacit assumption that mix- 
ture pixels and misregistration effects produce compensating errors. 

Some of these topics are analyzed more fully in the current report. 
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3 

APPROACH 

The planned approach for this effort was to place heavy reliance 
on. empirical simulations of misregistration to assess its effects on 
recognition performance. Multiteraporal data sets registered by a 
state-of-the-art procedure were to have been deliberately misregistered 
by several different amounts and the effects on recognition performance 
determined. This empirical analysis was then to have been supported 
and extended by theoretical analyses using signature simulation models 
to combine and transform signatures extracted from the accurately regi- 
stered data to simulate additional misregistration cases and conditions. 
Also, recognition results obtained from the accurately registered data 
were to have been compared with results obtained from data registered 
by the current LACIE procedure. Finally, of lowest priority, xjas to 
have been an assessment of the relationship between average field size 
and recognition performance in the presence of misregistration. 

The first months of the effort were primarily involved X'jith plan- 
ning the empirical simulation experiment and developing computer pro- 
grams to misregister the data. Also, development work was performed on 
the signature simulation models and, in the absence of the accurately 
registered data sets, some analysis of the joint effects of field size 
and misregistration was begun. 

The date by which NASA expected to deliver to ERIM the accurately 
registered data sets was progressively delayed throughout the contract 
period with the end results being that the data were not delivered before 
this report was drafted and the primary efforts planned for this task 
could not be carried out. The combination of the sliding delivery 
schedule for the essential data and pressing priorities on other tasks 
resulted eventually in a reduction of resources allocated to this task 
and an inability to meet all task objectives. Nevertheless, some useful 
results were obtained and are reported in succeeding sections. 
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The influence of misregistration on the proportion of multiclass 
pixels present in scenes was analyzed theoretically through the develop- 
ment of a model by which the expected proportion of multiclass pixels 
in a scene could be estimated. Parameters in this model are the total 
length of boundary in the scene, the number of nodes in the field 
pattern, the pixel dimensions (rectangular), the total scene area, and 
the amount of misregistration. A series of calculations and parametric 
graphs were produced using the model to esent the overall effects 
and dependencies. 

Both analytical and simulation techniques were developed to assess, 
theoretically, the effects of misregistration on classification accu- 
racy and proportion estimation. The basic computational tool intended 
for use was a program to compute probabilities of detection and false 
alarm based on signatures (mean vectors and variance-covariance matrices) 
Thus, simulation models were developed to combine and transform single- 
class signatures extracted from actual registered scanner data so they 
Wjuld represent signal distributions from misreglstered single-class 
and multiclass pixels. 

Five categories of pixels were identified for the analysis. 

Four of these are illustrated in Fig. 1: (a) pure field-center 

(single-class) pixels which remain single-class pixels when misregi- 
stered; (b) single-class pixels for which those channels out of regi- 
stration represent mixtures of two or more crop types; (c) mixture 
pixels for which channels out of registration represent different 
mixture proportions; and (d) mixture pixels for which those channels 
out of registration again represent a single class. A fift:h class, 

(e) , consists of multiclass pixels that due to misregistracion are 
made up of field-center pixels from two or more different classes. 
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FIGURE 1 


Crop W Crop 0 



ILLUSTRATION OF FOUR CATEGORIES OF MISREGISTERED PIXELS. 
(The three channels in. each pixel are offset vertically 
for clarity; Ch. 2 is msregistered by 1/2 pixel along 
the scan line.) 
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4 

INFLUENCE OF MISREGISTRATION ON THE PROPORTION 
OF MULTICLASS PIXELS PRESENT 

A significant effect of spatial misregistration, between two or 
more single-time data sets combined to form a multitemporal data set, 
is the potentially sizable reduction in the number of single-class 
pixels within the multitemporal data set from the number existing within 
any of the single-time data sets. Within a single-time data set (per- 
fectly registered between channels), two types of pixels may exist: 
single-class or field-center pixels and multiclass or mixture pixels 
which cross field boundaries. 

In a multiteraporal data set formed from two or more perfectly 
registered single-time data sets, all pixels will be of these two 
types and exist in the same proportions as in the single-time data 
sets. If, however, the single-time data are misregistered , a new 
type of multiclass pixel will be created and add to the total number 
of raulticlass pixels in the scene. A multiclass pixel which exists in 
misregistered multitemporal data has the characteristic that the pro- 
portions of its constituent classes differ betireen time periods and 
some of these constituents may even be different for the various time 
periods . 

An algorithm for estimating the expected proportion of boundary 
pixels occurring in data obtained by a sensor with a square pixel from 
a scene consisting of a ’*quilt" pattern of rectangular fields had been 
developed previously by Gray and Duran [4j. Dr. H. M. Horwitz of 
ERIM has developed a more general and simpler algorithm for estimating 
the value of this same quantity, based upon an intermediate result in 
Barbier's solution of the Buffon needle problem [ 5l* The ERIM method 
allows both for scenes consisting of non-overlapping polygonal areas 
(i.e., is not limited to rectangles) and for a rectangular pixel shape. 
Sec, 4.1 presents the derivation of this new estimation procedure and 
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discusses it in some detail. In Sec. 4.2, this estimation procedure 
is extended to estimate the expected proportion o£ multiclass pixels 
in multitemporal data that contain misregistration. Finally, in Sec. 
4.3, the models are applied. An estimate of the expected proportion 
of boundary pixels obtained by the ERIM method in each of four LACIE 
intensive test sites is compared to an actual measurement of this pro- 
portion obtained directly from the field pattern existing in the site. 
Also, a series of curves are presented, displaying the expected pro- 
portion of multiclass pixels determined by the ERIM method for both 
registered and misregistered multitemporal data containing fields of 
varying size and aspect ratio. Various pixel dimensions are also 
considered, 

4.1 DERIVATION OF ERIM METHOD FOR ESTIMATING THE EXPECTED PROPORTION 

OF BOUNDARY PIXELS 

Suppose that the scene S is filled by non-overlapping simple 
closed polygons as in Fig. 2, and that a rectangular grid G as illus- 
trated in Fig. 3 is placed at random on the scene S. The width of each 
rectangle in the grid is w and its height is h; each rectangle corre- 
sponds to one pixel, where the pixels do not overlap. Grid rectangles 
which contain the boundary of any polygon in the configuration S are 
then multiclass boundary pixels. The number of these boundary pixels 
is defined as a random variable B. 

To arrive at an approximation to E(S) , the expected value of li, 
certain preliminary results are required. Let y denote the total num- 
ber of crossings of lines in the configuration S with lines in the 
grid G, Then it follows from Ref. 5 that 



where L is the sum of the lengths of all the lines in configuration S, 
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FIGURE 2. TYPICAL SCENE CONFIGURATION 
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FIGURE 3. RECTANGULAR PIXEL GRID 
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When the dimensions of the polygons forming configuration S are 
large with respect to the grid parameters h and w, most of the boundary 
pixels x^ill be of two types; (a) those pixels v7hose edges have exactly 
two intersections with lines of configuration S and (b) those pixels 
which contain a single node of configuration S. (A node is defined 
as a point where at least three polygons meet.) Clearly, these two 
types of boundary pixels are disjoint classes. Assuming that the num- 
ber of boundary pixels of types other than these two are negligible, 
E(S) may then be related to E(y). Let a^^, a^j.-.a^ denote all the 
nodes in S, and let u(a^) denote the number of polygons meeting at 
node a^. Setting 

s = y_ u(a. ) (2) 

i=l ^ 

it can be shown by elementary counting arguments that 
E(S) - E(y) ” (f “ 

To prevent an overestimate of the number of boundary pixels due to 
the overhang of the grid on the scene, a factor 



must be subtracted from (3), where B is the perimeter of the scene. 

The resulting expression obtained then is 

(5) 

The expected proportion R of boundary pixels in the scene S is approxi- 
mated by 
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where N is the number of pixels in the scene, or 

R = (6b) 

A 

where A - N • (hw) is the area of the scene. It should be noted that 
when nodes in a scene are determined, the region exterior to S is 
counted as a polygon. For example, in Fig. 4, a^, a^, a^ and a^ 

are the only nodes and (a^) - 3, 1 i ± 4, and u(a^) = 4. 

When w and/or h are sufficiently small, the first term in the 
right-hand side of Eq. (5) increases and becomes dominant over the 
second term which remains constant. Substituting this first term 
into Eq. (6), the following additional approximations can be made: 



or 



(h + w) 


( 8 ) 


where P is the sum of the perimeters of all polygons in configuration 
S and is defined as 

P = 2L - B (9) 


Thus, in this limiting case, the expected proportion of boundary 
pixels is proportional to the ratio of the perimeter of the scene 
polygons to the area of the scene or to the ratio of the perimeter, 
2(h + w ) 3 of the pixel to the area of the pixel. 



FIGUKE 4. DETERMINATION OF SCENE NODES 
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4.2 EXPECTED PROPORTION OF MULTICLASS PIXELS IN MISREGISTERED 

MULTITEMPORAL DATA 

In the previous section a method was derived for estimating the 
expected proportion of boundary or multiclass pixels in single-time 
data sets or in perfectly registered multitemporal data sets. In 
this section, that method will be extended to obtain estimates of the 
expected proportion of multiclass pixels in misregistered multi temporal 
data. The misregistration in this data will be assumed to occur with 
a subset of data channels being misregistered with respect to the remain- 
ing channels and will be restricted to one pixel or less in magnitude 
either along the scan line or perpendicular to it. The dimensions of 
the pixel will be assumed to be small enough in comparison to the size 
of the fields in the scene that, essentially, all multiclass pixels 
which exist in the perfectly registered data are of the type that have 
exactly two intersections with the field boundaries. The assumption 
will also be made that the pixel dimensions are small enough that the 
boundary segment* intersecting the edges of each multiclass pixel in 
the registered data, can be considered as a straight line segment. 

No restrictions will be made on the shape of the fields which may exist 
in the scene; the only assumption which will be made is that the 
straight line boundary segments within boundary pixels are randomly 
oriented and distributed over those pixels. 

Given that a certain proportion of multiclass pixels exists in 
perfectly registered multitemporal data, the effects of raisregistering 
a subset of channels with respect to the remaining channels will he 
to increase the proportion of multiclass pixels. It should be recalled 
that the multiclass pixels in misregistered data will consist of 
different proportions of ground classes in the two subsets of channels 
and may even consist of different sets of ground classes in those 
channels. Figure 5 illustrates three cases for two adjacent pixels 
along a scan line and a misregistration between channels of a distance 
Aw along the scan line. , In this figure the solid lines represent the 
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FIGURE 5. EFFECTS OF MISREGISTRATION ALONG THE SCAN LINE 
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FIGURE 6. BOUNDARY LINE SEGMENT ORIENTATION 
WITHIN A PIXEL 
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position of the pixels in one subset of channels and the dashed lines 
repnesent the position of the pixels in tlie remaining subset of chan- 
nels mis registered with respect to the first subset. If the two sub- 
sets of channels were perfectly registered the solid line would indi- 
cate their position and in each case the right-hand pixel Is a multi- 
class pixel, while only in case (a) is the left hand pixel also a 
tnulticlass pixel* In the presence of misregistration, the right-hand 
pixel is still a muluiclass pixel in all cases but now the left-hand 
pixel in case (b) is also a multiclass pixel whereas in the absence of 
inisxegistration it was not . The effect of misregis tration (e . g,. , to 
the riglLt) along the scan line in multi temporal data is to create new 
multiclass pixels whenever both (a) a pixel which is not itself a 
multiclass pixel exists immediately to the left of one which is, in the 
registered data, and (b) the boundary segment within that pixel inter- 
sects the top or bottom edge of the pixel within a distance fiw from 
its left edge. Misregistration between scan lines results in a similar 
increase in the expected proportion of multiclass pixels. 

The proportion of multiclass pixels in perfectly registered data 
may be determined by the method derived in the previous section and 
will be denoted by R. The proportion of multiclass pixels in multi- 
temppral data which is misregis tered by. a distance Aw along the scan 
line will be denoted by R’ (Aw) . The proportion of multiclass pixels 
in the misregis tered data can then be expressed as: 

R'^;CA^> ^ -(10^ \ 


where the quanti.ty p^(Aw) is the probability that a line , randomly 
oriented about a point (x,y) chosen at random within a pixel, will ■■■ 
intersect either the top or bottom edge of the pixel within a distance 


Aw from its left edge . figure 6 illustrates a line segment through 


the point (x ,y ) and making an angle a with the vertical line drawn 

.L. 

through the point (x,y) . In this figure, the angles ct^(x,y) and ag(x,y) 




represent the range of angles over which the line segment will inter- 
sect the regions of interest along the top and bottom edges of the 
pixel, respectively. The angle will be assumed to be uniformly 
distributed over an angle of r radians to the left of the vertical 
line and the point (x,y) will be assumed to be uniformly distributed 
over the pixel interior. In App, III, p^(Aw) is derived analytically 
with the result that 




or letting 



w 


be defined as the aspect ratio of the pixel, and 
Aw ■ 

m = — 

w w 

be defined as the fractional pixel misregistration along the scan 
line, p^(Aw) can he written as 


p (Aw) — P (m ) 
c c w 


In (1+ f^) 


(l-m )' 
^ w 


(l-m )‘ 
' w 


Tf . 


cot 


1 
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and R’(Aw) can be written as 


/ + (l-m )^Y „ 

rum.) = = R 1 •• 7 ^ ^ 


\ j 2 -1 , ^Cl-Tirp -1 / r \ . . 


Using similar arguments the expected proportion of multiclass pixels 
in data which contains misregis tratipn of distance Ah between scan 
lines can be written as 


(4h) = R'(n^) = R 3. + ^ 


-—~r~ / + 27 “2 

lir ./ \ r 


liStLt i , 1 2 


(t)- 


"If 1 

■ ? yr(l-m^) 


where » as before 


h 

r = — 
w 


is. the pixel aspect ratio , and 
■ 'Ah 


is defined as the fractional pixel misregistration between scan lines, 
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4.3 APPLICATION OF ESTIMATION PROCEDURES FOR EXPECTED PROPORTION 

OF MDLTICLASS PIXELS 

The procedures developed in the previous sections will be employed 
in this section to estimate the expected proportion of multiclass pixels 
in both registered and misregistered multitemporal data from scenes 
containing either actual or simulated field patterns. The actual scene 
patterns will correspond to those existing in four LAGIE intensive test 
sites in the Kansas region. Estimates for the field patterns in each 
of these sites will be made, assuming perfectly registered LANDSAT 
data. These expected values will be compared with measurements 
obtained by an empirical procedure from one data set for each site. 

Next, simplifying assumptions will be made in the model to allow 
estimates to be obtc^ined in terms of the perimeter-to-area ratio of 
scenes containing the simulated field patterhs. 

These simulated field patterns will consist of a regular arrange- 
ment of identical rectangular fields of varviag size and aspect ratio. 
Curves will be presented, illustrating the dependence of the propor- 
tions on the dimensions of the pixel, the size and aspect ratio of the 
simulated fields, and the amount and direction of misregistration in 
the data. In addition, relationships between average field size and 
perimeter-to-area ratio x^ill be examined for the Kansas sites. 

Theoretical estimates of the expected proportion of multiclass 
pixels in perfectly registered multitemporal data were made for four 
LACIE intensive test sites in Kansas: Finney ^ Ellis, Morton, and 

Saline, A computer program was written to compute the quantities 
required in Eq. (5) from the vertices of a set of polygons describing 
the field pattern in each site.. The ground-equivalent pixel dimensions 
were chosen to pertain to LANDSAT data; the height of the pixel was set 
to 79 m and its width to 57 m. 

This width represents the separation between LANDSAT data values 
along the scan line. However, there is ah overlapping of the ground 
areas corresponding to adjacent LANDSAT pixels because the actual, width 
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of the LAUDSAT spatial resolution eiemant is 79 ni. The theot'etical 
methods developed in this report do not currently incorporate terms 
to directiy Aceouht for increases in the proportion of multiclass 
pixels due to such overlapping resolution elements* 

The empirical procedure relied on a determlnatioh of the number 
of field-center pixels in an actrtal LAflDSAT data set for each site, 
again neglecting the overlap present along the scan lines. This num- 
ber was subtracted from the total number of pixels in each site and 
divided by this same total to obtain the desired proportion, f'ield- 
center pixels were defined as those pixels with centers more than one- 
half pixel distance from the edge of each field, as determined from 
the set of polygons describing the field pattern. Table I summarizes 
the expected proportions cpniputed using the ERIM theoretical method 
and the corresponding empirical measurements * The average size of the 
fields in each site and the ratio (P/A) of the total perimeter P of all 
fields to the area A of each site are also listed.; 

This test is hardly sufficient to allow definitive conclusions 
to be dra\m about the accuracy of the theoretical method, but the 
results indicate that the theoretical expected values and thd corre- , 
spending empirical measurements of multiclass pixel percentages are 
reasonably similar. The average of the absolute value of the difference 
between the two values is approximately 6%, with the average difference 
being 2 % greater for the empirical measurement . Direct comparisohs of 
these two quantities must be made x^ith caution since the : theoretical 
estimate applies to the expected value for all possible orientations 
of. the sampling grid on the scene pattern, whereas the empirical 
raeasuroment is for just one of these possible orientations, further- 
more, the true proportions of multiclass pixels are not known exactly 
and the empirical measurements are believed to be slightly biased, 
(toward higher proportions) due to the xiray field vertices were defined. 
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TABLE I. FERCENTAGES OE MDLTICLASS PIXELS AND OTHER 
: CHARACTERISTICS OF POUR MSAS 

INTENSIVE TEST SITES 


Percentage of Multiclass - 
Pixels 


Intensive 

Test 

Site 

Expected 
Percentage 
Using ERIM 
Theoretical 
Method 

Empirical 

Measurement 

Average 
Field Size 
(Acres) 

P 

■ A: 

Ellis 

48% ^ 

41% 

■ 29 ■ 

0.012 

Saline 

43% 

51% 

34 

0.011 

Einney 

41% 

40% ' 


0.010 

Morton 

23% 

30% 

78 

0.005 




x.e. , there was a tendency to place each vertex slightly toward the 
field center to ins-ure good definition of field-center pixels. Also, 
the polygons were defined for other uses at different times by different 
ihdividtials for the various sites . More precise and controlled experi- 
ments will have to he conducted hef ore this accuracy can be better 
' evaluated. . ' 

Additional analysis of the results presented in Table I reveals 
that a ^ strong positive correlation exists between the P/A ratio and 
the estimate obtained by the ERIH tbeoretl cal method . The average 
field sige is negatively correlated with the. P/A ratio, resulting in 
an increased expected proportion of boundary pixels as the average 
field size decreases , 

The simulated field pattern consists of a large number of identi- 
cal rectangular fields, a small section of which is illustrated in 
Fig. 7. The dimensions of each field are C x D, with aspect ratio F, 
defined as 

F = C/D ^ 

.and area, Ay, defined as 
A^ = C • D. 

Assuming that the scene contains T such fields on a side, and that the 
pixel dimensions are small with respect . to the size of each field , the 
expected proportion R., of multiclass pixels in a registered data set 
obtained from the scene, is determined from Eq^. (8) as: 



2T^(C + D) 


(h + w) 


ft. + ^ 



c 


: FIGURE 7;. 


SIMULATED FIELD PATTERN 





where the ratio P/A Is given by 



Thus, the perimeter-to-area ratio of the entire scene is identically 
equal to the perimeter-to-area ratio of each simulated field. Eq. (13) 
expresses R in terms of the perlTne-tar-to^area ratio of the scene and 
the perimeter of the pixel. 

Figs. 8-10 present curves illustrating the dependence of the 
expected proportion of multiclass pixels on the dimensions of the 
pixel, the size and aspect ratio of the simulated fields and the amount 
and direction of misregistration in the data. Eq. (13) was used to esti- 
mate the expected proportion of multiclass pixels in registered data 
obtained from the simulated scenes and Eqs. (11) and (12) were used to 
extend these estimates to account for misregistration. Each figure 
contains two sets of curves. The top set represents the expected pro- 
portion of multiclass pixels as a function of the P /A ratio of the 
scene for various pixel dimensions or amounts of misregistration. 

The bottom set of curves represents the P/A ratio of the scene plotted 
against the field size of the simulated fields for several field aspect 
ratios. In addition to these curves for the siraulated field patterns, 
a curve is also dxa^ra through the points corresponding to the P/A 
ratios and average field sizes determined for the four intensive test 
sites . Since the top set of curves are related to the field pattern 
only through the P/A ratio , the approximate expected proportion of 
multiclass pixels in each intensiye test site can then be determined 
directly from these figures for the pixel dimensions and amounts of 
tiiisregistration represented by the top set of curves. Furthermore, 
assuming that the curve drawn through these points is repr es entative 
of the relationship between average field size and P/A ratio for the 
Kansas area, estimates may be. obtained directly from these figures for 
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any other site in the Kansas area, given the average size of the fields 
in the site. In the same manner, these curves could be used for other 
regions of the U.S. or world with similar field patterns . 

In Fig. 8, the expected proportion of multiclass pixels in per- 
fectly registered data is plotted in the top of the figure for four 
sets of pixel dimensions. The intersection of the dashed line with 
each of the curves in the top part of the figure indicates the expected 
proportion of multiclass pixels obtained for each set of pixel dimen- 
sions from a simulated scene containing 90-acre fields with a 0.5 aspect 
ratio. One point to note, which actually pertains to all three figures, 
is the greater sensitivity of the expected proportion of multiclass 
pixels to variations in the average field size and aspect ratio of the 
simulated field pattern when these quantities are small as opposed to 
when they are large. For instance, the difference in the expected pro- 
portion of multiclass pixels is much greater between simulated scenes 
with field aspect ratios of 0,25 and 0.1 than between scenes with field 
aspect ratios of 1.0 and 0,5. These differences are also greater when 
the size of the simulated field is 20 acres than when it is 100 acres. 

Increasing the size of the simulated fields while holding the aspect 
ratio fixed decreases the expected proportion of multiclass pixels . 
Increasing the aspect ratio of the simulated fields while holding their 
size constant also decreases the expected proportion of multiclass pixels. 
The pfoportioh of multiclass pixels is decreased significantly by the 
use of the smaller pixels; for example, a 30x30 m pixel yields less than 
1/2 the proportion of 57x79 m pixels and the 10x10 m pixel that might be 
associated with high-altitude aircraft scanner data yields only 1/6 the 
proportion. (Obviously, the estimation procedure breaks down for the 
57x79 m pixel and the lower, field aspect ratios.) From Fig, 8 the 
expected proportion of multiclass pixels in the Ellis site is approxi- 
mately 0.52 for a 57x79 m pixel whereas it is only about 0.23 for a 
30x30 m pixel, (The difference in this value for the 57x79 m pixel 
from that in Table 1 is due to the approximations used in Eq. (8) . ) 
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In ITigs. 9 and 10 the expected proportions of multiclass pixels 
in data containing one— half pixel and one full pixel of misregistration, 
both along the scan line and perpendicular to it, are plotted together 
with the same proportion for perfectly registered data, for pixel 
dimensions of 57x79 m and 30x30 m, respectively. For the 57x79 m pixel 
R'(ra^p equals 1.28 R for m^^ equal to 0,5 and equals 1.43 R for 
equal to 1.0, that is, misregistration increases the proportion of 
raulticlass pixels by 28% and 43%, respectively. For the same pixel, 
R’(m^) equals 1,36 R for equal to 0.5 and equals 1.57 R for m^^ equal 
to 1.0. The difference in the effects of equivalent fractional pixel 
misregistrations in the two orientations considered is attributable to 
the unequal height and width of the pixel. For the 30x30 m pixel, 

R'(in^) and =ite equal whenever m^ and are equal because the 

pixel is square; R'(m^) equals 1.32 R for in^ equal to 0.5 and equals 

l. 5 R for equal to 1.0. The effect of misregistration is equivalent 
to increasing the dimensions of the pixel by a factor determined by 

the shape of the pixel and the amount and direction of the misregistra- 
tion. This effective increase in pixel size results in the increase 
in the expected proportion of itiulticlass pixels as illustrated in the 
two figures. 

Fig. 11 is. a plot of the multiplicative factor [1 + p^(m)] by 
which the expected proportion of multiclass pixels in perfectly regi- 
stered data is increased due to a fractional pixel misregistration of 

m, for a pixel whose shape is. that of a sq;uare. The subscripts used 
previously bn the parameter m. have been dropped in this case because 
the square pixel shape negates the directional effects of the misregi- 
stration. The plot is obtained as a function of m by substituting r 
equals 1 into either Eq. (11) or (12) . The plot demonstrates the 
significant increase in the expected proportion of multiclass pixels 
even for small amounts of misregistration. The plot also illustrates 
the nonlinearity of the relationship between this increase and the 

amount of misregistration. 
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FIGURE 11. MULTIPLICATIVE FACTOR DETERMINING INCREASE IN 
EXPECTED PROPORTION OP MIILTICLASS PIXELS FOR 
FRACTIONAL MISREGISTRATION m AND A SQUARE 
PIXEL SHAPE 
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5 

THEORETICAL ANALYSIS OF MISREGISTRATION EFFECTS 
ON RECOGNITION PERFORMANCE 

As noted earlier, spatial misregistration, effects for single-class 
(field-center) pixels were considered separately from those for multi- 
class (e.g., mixture) pixels. Analyses and derivations of simulation 
models are presented in Secs, 5.1 and 5,2, with Sec. 5.3 containing an 
overall discussion of the effects of misregistration on recognition 
performance. 

5,1 analysis for SINGLE-CLASS pixels 

Pixels in this category remain single-class pixels even after mis- 
registration. The only effect of misregistration on data and signatures 
then is on the correlation between misregistered channels. Horwitz, 
et al, [6] and Coberly [7] have analyzed the correlation between the 
multispectral signals from ground resolution elements as a function of 
ground distance between their centers. Although both studied aircraft 
multispectral scanner data, conclusions were drawn for LANDSAT-size 
resolution elements. Wliat was found indicates that correlation between 
channels drops exponentially as registered pixels move put of registra- 
tion. Their results indicate for agricultural data that misregistration 
of field-center pixels would reduce the correlation between misregistered 
channels and that signals from adjacent LANDSAT pixels would he virtu- 
ally uncorrelated. Specific studies of spatial correlation between 
LANDSAT pixels were not made during this investigation. 

An analytical solution for probability of misclassification as a 
function of correlation can be obtained for the special case of two 
multivariate normal distributions with a common variance-covariance 
matrix. Such a relationship is discussed in Sec, 5.1.17, -A signature, ■ 
simulation model for more general cases is presented in Sec. 5.1, 2. 
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5.1.1 ANALYTIGAL SOLUTION FOR THE TWO-DISTRIBUTIQN CASE 
When consideration is limited to two multivariate normal dis- 
tributions with a common variance-covariance matrix, mathematical 
simplifications enable one to derive analytical expressions for the 
probability of misclassifying samples from the two distributions. 
Derivations of such expressions in terms of between- channel correla- 
tion coefficients are presented in App. I and are briefly summarized 
here . 

First, the optimum quadratic decision rule reduces to a linear 
decision rule for two distributions with a common covariance matrix, 
which simplifies the analysis. It is shown, in App. I that critical 
values of correlation exist in the expression for probability of mis- 
classification (POM) as a function of the correlation coefficient p 
between any pair of spectral channels. The maximum probability of 
mis classification occurs for: 



or 

Vl ’^1^2 


for -1 < p < 1 


p is the critical correlation value, 

c ■ . 

and are the differences between means of the 
distributions in Channels 1 and 2, 
respectively, 

and ^2 common standard deviations in the 

two channels . 

For + 1, the probability of mis classification is zero for 

P ~ ±1, so a plot of probability of misGlassification vs . correlatlan 
coefficient might appear as shown in Fig. 12 (other possibilities are 
presented and discussed in App. X). Probability of misclassification 
is a maximum at p = p^. The fact the misregistration decreases corre- 
lation has already been discussed. Thus, if the actual p were between 
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and 
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FIGUEE 12. ONE ILLUSTMTIVE EXAMPLE OF PROBABILITY 
OF MISCLASSIFICATION, AS A FUNCTION 
OF CORRELATION p IN FIELD CENTERS, FOR 
; . TWO NORMAL DISTRIBUTIONS WITH COMtION 
COVARIANCE MATRIX. 
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zero and p > a misregistration with its consequent decorrelation could 
c . 

actually decrease the probability of misclasslfication, contrary to 
usual expectations. Other simulation studies [2,3,8] have shown the 
net effect of Such situations on field-center classification accuracy 
to be slight, but it is interesting to explor a little further the 
mechanism by which such decreases would occur. 

Fig. 13 presents ellipses representing two distributions with 
common covariance for three different correlation coefficients . Points 
along an ellipse are equidistant from the center of the distribution, 
in a statistical sense. The middle ellipses correspond to the critical 
correlation value. The line connecting the means passes through these 
critical ellipses at the point where they are tangent to the super- 
scribing rectangles. Thus, the statistical distance between the two 
distributions is shorter (fewest deviation units) for these ellipses 
than for those of any other correlation value. The "fattest*' ellipses 
correspond to a correlation coefficient of zero. It is clear that if 
one. were to start with p - p and decorrelate, the distance between 

• ' ' . C • • • 

distributions would increase and probability of mis classification 
decrease, as illustrated previously. There also would he a re- 
orientation of the decision boundary between the two distrib ut ions. 

For the special cases, = ±.1, the maximum probability of mis- 
elassification would occur at p = and the minimum (zero) at P = + 1, 
All discussion thus far has been for two channels. App. I shows 
that the results can he generalized to n channels. Depending on the 
particular signatures involved, misregistratiph might . tend to increase 
the prohability of misclassification for some. channel pairs but decrease 
it for others. Also, in a multi class scene, the effects on different 
pairs of signatures may be different. Simulation is required in order 
to consider these effects in the analysis due to the mathematical com- 
plexities ^required for further analytical, efforts., ■ 
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iriGUEE 13 . Illustration of gritigal correlation for two 

DISTRIBUTIONS WITH COMMON COVARIANCE MATRIX 
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5.1v2 SIMULATION MODEL FQR MISREGISTERED SINGLE-CLASS PIXELS 
The model to simulate signatures from misregis ter ed field-center 
pixels was developed last year [2]. This model assumes that between- 
channel eorrelatloh is a decreasing linear function of misregistration. 


(See Sec, 5.2 for additional discussion of this assumption.) To be 

specific, let a perfectly registered distribution have mean and 

covariance C„, With some channel or channels misregistered , S would 

have the same mean vector but a different covariance Cj^. Any term 

of G,., say . would be related to a term of C_ in the following 
M Mxj ix 

manner : 


=Mij “ 'Elj 


where 


( 21 ) 


$ is dependent linearly on the degree of misregis 
stration, i.e., B = 1 denotes no misregistration, 
and 8 = 0 denotes misregistration by one or more 
pixels . 

Thus, if two channels i and j were misregistered by one-half pixel 
with respect to one another, then the covariance between i and j, 

, would be simulated to be bne-half the measured covariance 
Ml] ’ 

between 1 and j in the regis tered signatures . 

5.2. analysis FOR MGLTICLASS PIXELS 

Pixels considered in this section contain contributions from more 
than one scene class, either before or after misregistration or both 
before and after. They usually occur at or near field: bbundaries as 
mixture pixels. This section is devoted to describing the development 
of ap. improved, signature simulation, model for; which details are pre- 
sented in App, II. This model was to have been employed in analyses 
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of signatures extracted from the accurately registered data which were 
not received. Although the intended analysis could not be carried out, 
the rood el was tested and used in analyses of S— 192 scanner data under 
the SKYLAB investigation [3] which jointly supported its development. 
Sec. 5.2.2 discusses the effects of misregistration on the classifi- 
cation of multiclass pixels. 

Consider the case where the signal detected in one or more 
channels represents a mixture of ground cover W and some other ground 
cover 0. Furthermore, let there be misregistration between the 
channels. An n-channel multispectral signature for material W con- 
sists of a mean vector A with components a , where i = 1,. ..,n, and 

w wi 

a covariance matrix C xcrith components c^ , . for each i = l,,..,n and 

w wi ,3 

j = l,,..,n. Similarly, there is a mean vector A^ and covariance. 

matrix for the other ground cover. 

To construct the signature of multiclass pixels from the pure 

signatures of W and 0, let be the proportion of cover W present 

for each pixel in channel i and a . = 1 - a . be Lhe corresponding 

ox wr 

proportion of cover 0 present for each pixel. If the pixel were of 
pure cover "W then all i. The mean vector A^ of a mixture 

distriDution of crops W and 0 can be expressed in each channel i asJ 



a . A . + (1 ~ 
wx wx 



( 22 ) 


Any terra Cj^ ^ of the variance— covariance matrix can he expressed as: 


c„, . = min(ct . ,a ,) c . . + minCnt .. ,oi ) c . 

.Mi , 3 wi’ wj wx,3 >■-*- 0 2 oi.n 


Equation (23) describes the estimated covarXaace between any two 

channels of data as a function of the amdunt of misregistration being 

simulated for raulticlass pixels. The coefficients a . and a . are 

; WX . Wj - 

equal for the case of no misregistration. A detailed derivation of 
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this key relationship is presented in App. II, including an extension 

to misregistration in two dimensions slTnultaneously. 

Letting a . = a , and a . = a . in Eq. (23) j we have: 
wj wx oj ox 


c 


Mi,j 


cc.c. .+ot. c,. 
WX WX,3 ox ox,j 


(24) 


which is equivalent to the mixture estimation model previously 
developed and implemented at the Environmental Research Institute of 
Michigan [ 9]i A notable feature of both Eqs . (23) and (24) is that 
the weighting factors for the covariance terms are in terms of the 
first power of the mixture fractions, rather than the second power 
which would result if one modeled each mixture pixel as a simple 
weighted sum of two random variables. 

Let us next consider the covariance terms between channels in 
more detail in an attempt to more fully descrihe and justify the under- 
lying assumptions made in the derivation of this simulation model. 

Eigure 14 displays a possible conf iguration of the composite 
signal received by six different channels (or sets of channels in the 
case of multitemporal data) while viewing a single resolution element, 
Eigure 14(a) indicates that all six channels are viewing precisely the, 
same location, a borderline resolution element of wheat. This indi- 
cates a perfectly registered vector of signals. Eigure 14(b) indicates 
a vector wherein Ghannels 3, 5, and 6 are mlsregistered and actually 
viewing mixtures of wheat and other. 

eovariances for: Channels 1, 2> and 4 would remain identical in 
Eig. 14(b) to their values for the case shown in Fig , 14(a). The 
covariance for Channels 3 and 5 can be computed with the mixtures 
model (Eq. (24)), since they are in registta.tioh with each other. 
However, ih the presence of misregistration, such as between Channels 
1 and 3 or 3 and 6, the generalized equation (Eq. (23)) is required for 
the covariance computation. 
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t J 

Otlior 1 Wheat Other [ Wheat 



. i:' - i 

I . ^ 

(a) Perfectly Registered (b) Misregistered 

FIGURE 14. AN EXAMPLE OF CHANNEL MISREGISTRATION 
TOR A SINGLR RESOLUTION ELEMENT ; " 


Other Wlicat 



(a) Misregistered (b) Totally Misregistered 

(with overlap) (no overlap) 


FIGURE : 15. A MISREGISTRATION CONFIGURATION IN TWO CHANNELS 
FOR A SINGLE RESOLUTION ELEMENT, ILLUSTRATING 
WEIGHTING FACTORS IN COVARIANCE MODEL 


41 




Figure 15(a) displays the areas associated with the various com- 
ponents of Eq. (23), Note that a . = minfu . .a ,) gives the propot- 

wj ' wi * w j 


tion. of overlap (area cross-hat ehed) between the two channels in the 
wheat field. Hence a ,c . , is the contribution of c , , to the con- 

WJ ■ . WljJ 

structed covariance term c^,. Similarly, n . = min(a . ,ot . ) is the 

proportion of the other field that is common to both channels i and 3 

(area hatched) and a , c . . is the contribution of the covariance of 

ox ox , 3 

’other' in channels i and j. Hence, where there is no overlap (unshaded 
area), the cross correlation is assumed to be negligible and therefore 
zero , 

Figure 16 illustrates a comparison between the covariance esti- 
mated by the derived model and two hypothetical true covariance func- 
tions , The differences between the model and the two other curves at 
(1 - a^) - 1 could be caused by a finite correlation between adjacent 
pixels and/or by scanner noise and atmospheric noise contributions 
which were not considered in the model. Studies similar to, and in 
addition to, those of Refs. 6 and 7 would be required on satellite 
data as well as aircraft data to better define the true functional 
relationship. 

5.3 DISCUSSION 

It was shorn in Sec. 4 that a major effect of misregistration 
is to reduce the percentage of . field-center or single-class pixels 
in a scene and correspondingly increase the percentage of multiclass 
pixels. Another effect is the reduction of correlation between sig- 
nals in mis registered channels. The simulation models developed, earlier 
in this section allow one to explore the effects of these changes on 
recognition performance. We here consider and summarize these effects 
In a qualitative manner for LACXE multitemporal recognition, relying 
on experience gained in using these models in other work on spectrally 
misregistered single-pass S-192 data and multitemporally misregistered 
two-pass CITARS data. 
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MISREGISTRATION (1 “ a^) IN PIXELS 


EIGURE 16. COMPARISON OF THE CORRELATION FUNCTION IN THE SIMULATION 
MODEL WITH HYPOTHETICAL "TRUE" CORRELATION FUNCTIONS 


Best Linear 
Decision Lines 



SIGNAL IN CHANNEL i 

FIGURE 17. ILLUSTRATION OF MISREGISTRATION EFFECTS 
FOR SINGLE- CLASS PIXELS 
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Fig, 17 Illustrates misregistration, effects in field centers for 
single-class pixels. The "fattened" ellipses and the rotated decision 
line are consequences of misregistration. As discussed in Sec. 5.1.1, 
probability of misclassification between pairs of classes might 
increase or decrease upon misregistration, depending on the relative 
positions, shapes, and orientations of the class ellipses (representing 
the distributions of signals in the classes). Experience to date has 
shown these effects to be minor in simulations using multiple channels 
and multiple classes in agricultural scenes . 

The situation is more complex for multiclass pixels, as illus- 
trated in Fig. 18. With no misregistration, multiclass pixels would 
be simple mixture pixels. The means of their distributions, as seen 
in Fig. 18(a) , would lie along a line, such as AB, for mixtures of 
scene classes A and B, 

With 1/ 2-pixel misregistration, the pattern of mixture distri- 
butions would split and change, as shoTTO in Fig. 18(b). The rounder 
ellipses indicate the decorrelation effect within individual classes. 
The mixture distributions would be shifted symmetrically away from the 
no-misregistration line of mixture means, causing some of them to be 
much closer to the competing signature classes, C and D. This shifting 
iTOuld result in greater probabilities of falsely identifying mixtures 
of A and B as samples of classes C or D. The effect would he intensi- 
fied even more with a misregistration of one pixel (See Fig. 18(c)). 

The above examples and the previously referenced simulation work 
do indicate that misregistration can adversely affect recognition per- 
formance with misregistered data. The errors produced by misregistra- . 
tion will not necessarily compensate either for each other or for 
recognitipn errors due to other sources. The effects depend on the 
particular signature configuration encountered. That is the main 
reason for the originally planned simulation of fegistratibn errors 
in selected LACIE multltemporai data sets . The tise of accurately 
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(a) No Misregistration 


Line of Means for 



Line of Means for 









registered data for extracting the base slngle^class signatures was 
deemed essential because be tween- time-period correlation was the least 
known parameter in the prior simulation study. It also would be 
desirable to develop some analytical measures which are less dependent 
on particular signature configurations. 
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6 

EMPIRICAL ANALYSIS OF MISREGISTRATION EFFECTS 
ON RECOGNITION PERFORMANCE 


In preparation for Che receipt of accurately registered data, com- 
puter programs were t^ritten to deliberately misreglster these data by 
fixed amounts, either along the scan line or between scan lines. They 
implemented a cubic convolution algorithm [10] for interpolating data 
values . 

As indicated earlier, the opportunity to apply these programs did 
not occur. They would have completed a two-step procedure for genera- 
ting data misregistered by kno™ amounts for analysis purposes. Such 
data would have served useful ends. However, we note that a more radi- 
ometrically accurate procedure that should be considered in futci'e t<rork 
is a single-step procedure going directly from unregistered scenes to 
deliberately misregistered data. 

A test also was made to determine the amount of be tween-channel 
misregistration in single-time Landsat scenes, A procedure developed 
under another investigation [3] was used for this measurement. The 
cross-correlation function between signals from pairs of Landsat chan- 
nels was computed at fractional pixel increments. The amount of misregi- 
stration was estimated by the shift parameters corresponding to the peak 
of the cross-correlation function for ten scan lines, each having 500 
points. Both an average misregistration and the standard deviation of 
that average were computed. Results are presented in Table II for two 
pairs of channels, (1,2) and (3,4), The signals for the other combina- 
tions of channel pairs were not highly enough correlated to yield mean- 
ingful results. The results in Table II indicate that no significant 
amount of misregistration is present between the given channels in these 
single-time Landsat data sets. Although precise results were not 
obtained for the remaining channel pairs, there has been no evidence 
of which we are aware to indicate that a signifiGant amount of misregi-r 
stration exists between any pairs of the four Landsat channels. 
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TABLE II. ACCURACY OE BETlffiEN-CHANNEL REGISTRATION 
IN LAND SAT MSS DATA 


Data Segmeat: Finney, Kansas 

26 May 74 


Ellis, Kansas 
12 June 74 


Standard Standard 

Average Deviation Average Deviation 

Channel Misregistration of the Misregistration of the 

Pair (Pixels) Average (Pixels) Average 


1-2 -0,068 0.026 -0.035 0.014 


3-4 -0.089 0.013 -0,055 0,014 
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APPENDIX I 

A SIMPLE ANALYTICAL MODEL TO STUDY THE EFFECTS OF 
MISKEGISTRATIGN ON FIELD CENTER GLASSIFICATION ACCURACY 


Insight has been gained into what effects spatial misregistration 
may have on field-center classification accuracy through an analytical 
analysis of the problem. Consider two normal distributions in n chan- 
nels , ’ with a common covariance R. The proba- 

bility of a type-one error* using the best linear decision rule is 


where 


^[l/2(p^R VA 


$ (x) = 



/2tt '' 

X 




(I-l) 


( 1 - 2 ) 


and 




the channel to channel mean difference. 


Studies have indicated that misregistration from channel to channel, 
or time period to time period in the case of multitemporal analyses , 
causes resultant signatures to be less correlated. This analysis, 
therefore, attempts to examine the error rate as a function of corre- 
lation p 





"under the assumption of common covariance, type-two error is equi- 
valent to type-one error. 
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Also, let f(p) = \ for -1 < p < 1 

and g(p) = l/2f(p)^^^ 

£(p) -4- m at p = ± 1 , except for ” ±. ^ 2 ^ 


(1-4) 


Similarly g(p)"^“ at p = ± 1, x^hich implies x + « at p = ± 1. * can be 
expressed as a function of p through f(p) and/or g(p): 

4(x) = ^[1/2 f(p)^^^] - $[g(p)3. 

Substituting x = “ into Eq. I'’2 vie have !(*) =0. We have established 
therefore, that the error rate ^ is minimized for correlation p ^ + 1. 
The only exceptions are when ~ 0 = + 1 and when 

^2 = -y^ ^ ~ xjhich cases has a finite value which 

will be sho™ later to be a maximum of 'Kg(p)) . Let us noxv examine the 
behavior of the function ‘i' for -1 < p < 1* 

Although restricting ourselves to txTO channels x<re note that the 
following analysis can he generalized for p,. , the correlation between 
any pair of channels i and j . 

Let us now calculate the first derivative of f (p) : 


f(p) = yV^y 


df(p) 

<i<p) 


t d R 


-1 


dp 


(I"5) 
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We eati simplify the calculation of 
relationship between — v_ and ‘ 


d R 


-1 


dp 


by noting the following 


dp 


do * 




Solving for 


dR 


-1 


dp 


we find: 


dR 


-1 


dp 


R- "- 0 R-1 


( 1 - 6 ) 


Substituting Eq. 1-6 into Eq. 1-5 and solving: 


mel ../r-" i*R-\ 

dp Qp 


Noting 


that = [(R'S^y]" and = R ^ 


d|(pl = „ ^ (R-lp) 

dp ' ' dp 


( 1 - 7 ) 


Eq. 1-7 is an expression for the first derivative of f(p) in. terms of 
the derivative of R. Now let us examine if., for -1 p < 1, critical 
values of f(p) exist. Individually examining the components of Equa- 
tion (1-6), we determine the following expression for two channels: 


3 ^ 

^ 


.-1 



( 1 - 8 ) 


dp " '’l°2 


c 

10/ ^ \l 0 


(1-9) 
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Now substituting 1-8 and 1-9 into 1-7 J 


df(p) 

dp 


“ 2 ^ ‘=21 u ) ^ ( aJ ‘ '• -"= 2=1 


- ^<=1=2>L, 


= 2baj^a2 ! b > 0 


(1-11) 


For = 0, either or a„, one of the two rows of R must equal 

dp ’ 12’ 

zero. Since $(x) 2. 0 and continuous, and has minima (zeroes) defined 
at p = + 1, then $ is maximized at 




for -1 < p < 1. 


( 1 - 12 ) 


\ ^ 

For the special cases when >-‘2 " **' *'2 ~ ~ ' 2 \ ■^ / * 

tinues to have a minimum at p = -1 and p = +1, respectively. However, 
at p = +1 and -1 for these cases, respectively, Eq. (1-12) applies and 
shows that * has a maximum. 

Before examining the implications of this result, let us show how 
this result can be generalized. 

Eqs. 1-5 to 1-7 can be generalized by letting p - P^^. and 


dR ^ SR 

do 3p . . 

11 


for any pair of channels i and j , 


Hence : 




9f(p..) t»„-l 

1.1 „ M SR P 
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Examining a three-dimensional easei 




R = 02^ 


^ 23 ^^ 2 ^? 


Pl3°1^3 ^23'^2°3 y 


Therefore : 


Following the same line of reasoning as in two dimensions [Eq. I-IO and I-ll] 


we find that 


af(Pi2) 


- 0 when either the 1st or 2nd row of R" y is zero; 


similarly for f(p 22 ) arttl ^^^ 13 ^* 

We can now generalize to conclude 
4 ) . 

— r ^ — = 0 at some p . , in the Interval defined by -1 < p . , 1 

3p . . cx,J 3.3 

for any pair of channels i, j. The point p . . can be calculated 

Vi 

exactly by setting the i**^ or j*-“ row of R"^ equal to zero and 
solving for p. The function f is a function of many variables, 

f (P i 2 ,Pi 3 , . . . >Pij , . . .) for all i,j* We have determined that (1) the. 
function <}> is minimized along its boundary in the interval -1 ± P ± 1 
and (2) the function f has a critical point at p . , with respect to 

J 

each variable p* . for all i and j and these critical points must be 

3- ,3 

maxima. Under these conditions we can conclude that the function $ 


reaches a maximum, on the interval -1 < p.. < 1. 

13 
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Let us BOW examine tlie implications of this analysis graphically 
for two channels of data: 


CA.SE 1 CASE. 2 CASE 3 



FIGURE I-l. ERROR RATE OF RECOGNITION AS A FUNCTION 
OF CORRELATION p IN FIELD CENTERS 


Figure I-l displays possible curves mapping the error rate in 
field centers as a function of p, excluding the special cases with 


p = + 1. A maximum error occurs at p . is minimized at p = + 1 
c ~ c 


and intercepts the y axis at p == 0, f(0) = f(0) 



P occurs at p 
c c 


■i“2 

— or 

"l°2 


Let p^ be the correlation of a registered data set in two channels 

and let p be the correlation of the same data set but misregistered 
m 

to varying degrees. Keep in mind that misregistrating data will cause 
the correlation to decrease. Let us examine each case depicted in 
Figure I-l separately. 

CASE 1 

(1) If 0 ^ ^ ^ 1, then raisregistering the data set would 

cause the error rate to increase until p = p , then it would restore 

m e 

accuracy somewhat until R =0. 

■ m 
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(2) If 0 ^ i then misregistration would actually 

improve results , 

(3) If “1 ^ ^ 0) then misregistration would cause the error 

rate to increase, 

(4) If 1, misregistration would always improve field center 

results . 

CASE 2 

(1) If -1 1, Pj. ^ P^ 0, this behaves as case 1, step (1) . 

(2) If ~1 Pj. 0, see case 1, step (2) ► 

(3) If 0 5 1. 1, see case 1, step (3> * 

(4) If P “1, see case 1, step (4). 

c 

CASE 3 

In this case misregistration would always cause the error rate 
to increase. 
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APPENDIX II 

DERIVATION OF COVARIANCE ESTIMATION MODEL FOR 
>IISREGISTEEED MULTICLASS PIXELS 


In the derivation of the covariance estiraation model, we restrict 
oiirselves to two channels of data and two crop types . Figure II-l 
illustrates a possible configuration of boundary elements for two 
channels misregistered with respect to one another. It is the cross- 
correlation between two such channels that we are interested in calcu- 
lating. 


Crop 1 I Crop 2 


resolution 
channel j 


in 



k 


resolution in 
channel k 


FIGURE II-l. CONFIGURATION OF BOUNDARY RESOLUTION 
elements OF TWO CHANNELS OF DATA MIS- 
REGISTERED WITH EESPECT TO ONE ANOTHER 


Let S_(a,6) be the signal per unit area from ground coordinate 
(a, 3) for the i^^^ crop, j channel. This signal is assumed to origi- 
nate from a stationary random process, with statistics: 

E[S^^Ca,6)] = A^^ 

= 6(x,h) 
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is Kronicker’s Delta Function. If irh, i.e., two different 

crops, correlation is assumed to be zero. 

r . (a -a is the cross-correlation function and is depend- 

J ci jC JL ■ 

ent on the distance between the locations on the ground. 


The assumption made is that the correlation between two pixels drops 
rapidly as the distance between two pixels increases. The correlation 
between two adjacent pixels is assumed to be zero. 

The scanner signal in the j^^ channel is the sura over the resolu- 
tion area of all signals S..(a,3): 


X, 

J 



d. 


c. 

3 


d3Si^ (a, 8) + 



d. 

dB (a,B) 

c . 

3 


with statistics; 


0 ^3 


b^ d. 


Efej) - 


f 

da 




a, c. 

3 3 


0 J 


X. - E(x.) = 

3 3 


da 


b. d. 


dB[S3_^ (a,P) - + 


a. c. 

3 3 


da J dS[S2. Ca,B) - A2j] 

b c. 

3 
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The correlation between channels j and k is : 


0 

1 

d. 

dOj^ 

dgilSi^ (ai^Bl)-Ai^] -h 

a . 

2 

c . 

2 

0 

► 

^k 

ddi 

*^^1 ^®ik^ 1’ 1^ ^ ^ik^ 


‘^k 


b. d. 

.2 J 


*2j ” '^2j^ 


b, d, 
fc k 


0 c. 


Multiplying this expression out we note that cross terras drop out due 
to Kronecker's Delta; 


0 d 


0 d, 


n r 

^jk ‘^'"l ^®1 ^^^2 ^^^2 ^ljk<^“r“2’ V^2> 




4a ^k 


da^ d3^ da^ dB^ <“r“2’ 
} . J i. ^ 


0 c. 0 c. 

2 ^ 


To siraplify the algebra let d^=d^. This means that only mis- 

registration in one direction is considered. We will generalize later 

J# 

to two directions. Using this assumption along with an identity", 


* Simplified using the identity 

B B B-A 


I |eC- 

A A 


v) du dv = (B-A) jF (x 
-CB-A) 


fp (x) ( 1- \ 

LA^ \ B-a/ 
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( 



0 0 d-c 

1 ^“2W->=> I 16 

a. a, -(d"c) \ / 


a. 4 04 

3 k 


d-c 


1 

0 b 


da^ (d-c) 


j '23kK-“2’^> ("• - 

-(d-c) \ / 


d-c 


Let - <d-c) 


and similarly 


/ijk ^-“2-8^ 46 

-(d-c) ’ \ / 


d-c . 

^2jk “ Kik (“i-“2'®> l^-M) 

-(d-c) \ / 


de 


Substituting we have: 


R., 

3^ 


0 0 
f 

da^ 


b , b. 


■*“2 ®ijk-“r“2^ + j 


fJ 

da. 


a. a, 

3 k 


1 

0 0 


^V2jk^“r“2^ 


Wow examine each component of R^^ assuming that < a^^ (the 
applies otherwise). 


0 0 
da. 


<‘“2 ®'ljk <“i-“2^ 


a, a, 

3 ^ 


C»4 ' 

•1 ' 
■ 

l« 

\^i j 

^“2 ^Ijk <“2-“l> + J 

da. 


dc.2 («2-V 


a . a. 
3 k 


\ \ 


r \ 

J4“i J4“2 fjjfc J^Uk‘“^ fl-M) 4a 

a. a, a, ^ “^k/ 

3 


(II-l) 


same argument 


(II-2) 
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The contribution to the estimated covariance from any non-overlapping 

region is assigned to be zero. The left component of Eq. II-2 

determines this contribution, hence it can be eliminated, Thus the 

left hand term ot R,. is: 

jk 


Similarly for b^ < b^ we find; 


(II-3) 


^“2 hjk Kjk 

0 0 V i) 


(I WO 


Substituting Eqs. 11-^3 and II-4 into Eq. II-l we have; 

V ^ l'2jk f’if) 

If the pixels being examined were pure crop 2 pixels, the expression 

evaluated for R,, would be the covariance R»,, between channels j and 
jk 2jk 

k in crop 2. In order to simplify the expression for a border pixel 

we need to evaluate it in the field center case. 

For crop 2, a, = 0 and let b . = b. = b, hence 
X J X 


b b 


R., = R„., = 0 + 
jk 2jk 


jdo.2 Fyk 


0 0 


Simplifying ! 


, jk “ l^hjk <“> I--M 
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Similarly for crop 1, bj = 0, and let - a^^ 


= a 


a 

r 


^Ijk = " 


^Ijk 


(II-7) 


We know have 


V and R, , the covariance terms for channels j and k for 
2jk l^h 

crops two and one. 

a, mixed pixel) we make two observations. 

I 

(1) The covariance of two points on the ground drops very 

rapidly as a function of the distance between them then: 


(2) To substitute Eqs. (H-6) and (II-7) into Eq. (II-5) we need 
to normalize by dividing respective terms by a and b, the 
widths of the respective pixels. 


Having made these observations we can conclude for a boundary pixel, 
the covariance can be calculated using the expression 






(II-8) 


Eq . II-8 was derived under the assumption that misregistration was in 
only one direction. The simulation model described in Sec. 5.2 is 
based on this assumption. The analogy of Eq. II-8 with misregistration 
in two directions is a trivial extension of Eq. II-8 and is determined 
to be : 







(II-9) 


where c = d, -c, and d = d,-c. are the heights of each resolution element, 
k k 3 3 

We note that in our case the widths of the respective pixels are 
the same size, hence a = b. Therefore, ak/a is the proportion of 
overlap in crop 1, and bj/b is the proportion of overlap in crop 2. 
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APPENDIX III 

DERIVATION OF EXTENSION TO ERIM METHOD TO ACCOUNT FOR 
effects of MISREGISTRATION ON EXPECTED PROPORTION 
OF MULTICLASS PIXELS 

The ERIM method for estimating the expected proportion of multi- 
class pixels existing in perfectly registered data will be extended to 
estimate the expected proportion of multiclass pixels in misregistered 
multitemporal data. In Section 4.2, the situation is discussed in detail 
and the basic approach to the extension is presented. For misregistra- 
tion along thr scan line of distance Aw, the expected proportion of 
multiclass pixels is given by 

R’(Aw) = R[1 + P^(Aw)] 

where R is the expected proportion of multiclass pixels when no mis- 
registration is present. Similarly, for misregistration between scan 
lines of distance Ah, the expected proportion of raulticlass pixel.s is 
given by 

R’(Ah) = ,1 + Pj,(Ah)3 

The quantities Ah and Aw are restricted to values less than the pixel 
dimensions h and w, respectively. 

Recall that the assumption was made that the boundary segment 
within each boundary pixel may be considered as a straight line segment. 
The quantity p (Aw) whiuh must be determined, is defined as the proba- 
bility that such a straight line boundary segment, randomly oriented 
about a point (x,y) within a boundary pixel, will intersect either the 
top or bottom edge of the pixel within a distance Aw from its left edge. 
Referring to Fig. 6-, the angle ot between the boundary segment line and 

• Li 

the vertical line drawn through the point (x,y) will be assumed to have 
a uniform probability density p(ct ) over an angle of r radians to the 

J-i 

left of the vertical, that is 
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P( 



0±a^l 


IT 


The point (x,y) about which the boundary segment is oriented will be 
assumed to be uniformly distributed within the pixel mth probability 
density p(x) for the x-coordinate, given by 

p (x) = ^ 0 < X ^ w 

w 

and probability density p(y) for the y-coordinate, given by 
p(y) = i 0 < y £ h 


The angles a (x,y) and a (x,y) represent the range of angles through 

1 D 

which the boundary segment oriented about (x,y) will intersect the two 
critical areas along the pixel edge. The probability p^(Aw) can then 
be expressed in terms of these angles, as 


C3:) ic 


(Aw) 



UO 



[a^(x,y) + a^(x,y)] p (x)p (y)p (a^) dy dx da^ 


h 

1 

Tthw 

0 


w 

[ [^‘g(x,y) + oi^(x,y)] dx dy 

6 


which due to symmetry can be simplified as 

h w 


p^(Aw) 



0 


J a^(x,y) dx dy 
0 


The angle u^(x,y) will now have to be considered as two angles a^^(x,y) 

and a *(x,y) depending on whether x is less than or equal to Aw or 
BZ 

greater than L\o, Fig. III-l illustrates each of these angles. In 
terms of these two angles, p^(Aw) will now be expressed as 
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FIGURE III-l. ILLUSTRATION OF ANGLES a^^(x,y) AND a^^(x,y) 



FIGURE III-2. DETERMINATION OF ANGLE a„„(x,y) 

EZ 
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p (Aw) = — r— 


h Aw 


h w 


a^^(x,y) dx dy + 


dx dy 


0 0 


0 Aw 


(III-l) 


Over the range of x values less than or equal to Aw, ag^(x,y) is equal 




and the first term in the brackets in Eq. (III-l) , denoted as T^, can 
then be written as 


h Aw 


"(f) 


dx dy 


(II1-2) 


Using the identity 


tan ^ 


-1 / u \ a / 2 , 2. 
= u tan ( — 1 " — In (u + a ) 


the integration over the variable x in Eq. (III-2) can be performed 
and evaluated at the proper limits with the result that 

■hr 

= Aw cot~^ (aw) “ (2) ■ 

0 L 

+ (|)ln,(y^) dy (III- 


Dsing the identities 


cot = u cot ^(j^-byln (u^ -i- a^) 
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-I F 2 2. , . . 2 , 2. 

u In (u + a ) du = ln(u + a ) - 


2^2 
u + a 


du 


and 


r 3 2 2 9 9 

f du - a- - y- ln(u + a) 
u + a 


Eq. (III-3) can be evaluated over the range o£ integration, with the 
result 


\ (Am) 


j)- in (l + -^j+ 2HMh 


) 


In Fig. III”2, two angles 6(x,y) and Y(x,y) arc shown from which 
a (x,y) is determined, as 

a^ 2 (x,y) = y(x,y) - 6(x,y) 


These two angles can be expressed as 
y(x,y) = tan ^ (y ) 

and 

6 (x,y) = tan ^ 


permitting the second term in the brackets in Eq. (III-l), denoted as 


T^, to be written as 


T = 
2 


h w 

r r 


0 Aw 


tan 


-17 X 




dx dy 
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Using the same set of identities used to evaluate the term can 
be evaluated as 


\ (w“Aw) y 

+ 2 (w“Aw)h cot ^ ^ w" Aw ) 


In ( 1 + 


The probability p (Aw) can then be written in terms of T and T_ , as 
^ X z 


Pc''"') - 'b b' 


which upon combining terms, can be written as 


1 + 


(w-Aw) ' 


p (Aw) 
c 


2ttw 


In 


i 


w 


2’"'“ ' («-4w) 


2 i TT 


2 . -1 
+ — cot 


(I) 




TTW 


(—) 

\ w-Aw / 


Letting 


r = 


w 


be defined as the aspect ratio of the pixel, and 
Aw 


m 


w w 
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be defined as the fractional pixel misregistration along the scan line 
R'(Aw), or equivalently R'(in^) can be expressed as 



Using similar arguments can be determined in terms of a frac- 

tional pixel misregistration between scan lines of nij^, defined as 

Ah 

^ = tT 

and can be expressed as 
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